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(54) METHOD FOR VIDEO OPERATION, VIDEO SEARCH, VIDEO PROCESS DEFINITION, REMOTE 
OPERATION MONITORING, AND DEVICE OR SYSTEM 

(57)Abstract 

PURPOSE: To enable an operator to intuitively grasp an object of 
operation and its operation result on a remote operation monitor 
system. 

CONSTITUTION: When the display position of a button 414 in a 
video display area 200 where an image from a camera 60 is 
displayed is pressed with a finger strongly while horizontally moving 
the finger, a man-machine server 20 sends a command to an 
actuator which controls a knob 424 through a computer 50 for 
control each time the finger moves and actually moves the knob 
424 according to the motion of the finger. As a result of the 
movement of the knob 424, the pointer of a meter 422 also 
deflects. How the knob 424 moves and the pointer of the meter 
422 deflects is photographed by the camera 60 and an image is 
projected on the video display area 200. Consequently, the 
operator feels as if he moves the knob 424 with his finger. 
Therefore, the operator can feel as if he were moving a remote 
equipment actually. Consequently, the operator can grasp the 
object of operation and the operation result intuitively and 
misoperation is reduced. 
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V^5fc»SB*t*ffift;-rSi:^3KHt>*-S. . 
[0006] 

urn**** u«fc 3 ttzum ±mm>jzm, 

»K«T3B©Kg#*ofc. 
[0 0 0 7] (1) «fN8±©*-, U/t-fc 
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(**.«. EE^jasaf©? 4 -^) t*»±<ai:c« 

[o o 1 2] *^^©awtt. f»gatt^«©fflji«« 

ftU TIB (1) *»S (6) ©'>fc< <ht>-r>£8£f 
[0 0 13] <1> *|H»EE&£';i?A*IC&»T. 

[0 0 14] (2) ij*5©S»«\ #*7©8Rgg*re 

[0 0 15] (3) 8ROTgE8>'XxA&.»:©/hffi 
[0016] (4) A^y^ftti'^^wyi'X-en-f 

(5) «ao«****<«ffi»«-ce«±5fc-r4j: 
« t. *^9«n»T?saffi«i/Tw*«»©iafl! 

[0 0 17] (6) ±i2BSj£iiJ®-r-5J;a*v>v-> 
[0 0 18] 

[Kgsfcife-rsfc*© 5 ?©] *KWt«fcn«B!ifaa« 

(1) ~ (5) BTEX??^«tt5*ftt:J:oT« 
[0 0 19] (1) ty^xf hft^Xxy^ 
50 ys>xirht»«50 S^^^rA-fX <KT. 



7 

88 ©x frSfSS-LfcOfS. tf-^TV 

h V?X. 7-f i>x;*^vAftgEfc<2:£ 
J8V>5. *7V>^9 VomfeftHZ. &®rt©ltjrB7t8fc 
t^i^h*. 9^7 * v 97,<r)^fo^\z&V)Wk 

C0020] (2) iaanffxx;;^ 

[0 0 2 1] •m£3*lft*:/i>x*h£»f£S1*.53: 

sis. w*tf, m«a*xfc*y^xi'h*^>-c»s 

[0 0 2 2] -}&«3nfc^i;x^h»cS^T»« 
S. **5©l3l££Ito>L-C. 9*{&©*5fel::*&££nfc 

[0 0 2 3] •^3eS^fc^-/^xi'h*t^3n-5J; 

[0024] • ««atift:*^yx^ hfcwar«wB 

[0 0 2 5] • »SSn&*^i?x^ hfcMLT^fr «J 
[0 0 2 6] *»WfcJ:ntfWgBW (2) Br- 

[0 0 2 7] *&<mz&tummmto (6) ». eft 
y y t swrs^tsic £0 t#*3 na. 



(5) 1SBPF4-308895 
[0 0 2 8] 

Cff«] iBBlOKftlWIfit!)*^!? hStt&lt 

£9&ikg#tftntiE. *©■«»* X7tfcftce«>g£ 

^asjs-easMftfpcs*. cnc«fct>T. ®##tm 

[0029] affi±-e»3ean&ifc«i»3©*^s?x^ h 
si*. cinfcckoT. *»rt©*^x^ hsjftrra 

[0030] *ftrt©*73>x» hKi«Wifl««o*.* 

a— tf*»*7-S?xjr h£fgj£U&S, £©*7*?x 

f h*«Jissnfc©*>*w^-r*±5fey57^y^x 

0fS©$lS&a« , f*fc»S>©;*:=»-S«j5 , r 
30 S8t2£Q&<8z>Z.ttftV&Z. 

[0031] iis±-eti£*n&iwirt©t^if h 

afc*ttt> £tf«T*a. W«i:<B©fi?«i:* 

a. 

[0 0 3 2] x*Xh*fc«B#£»fg*-fcUTA;*J 

u wffiA*.ufc8g3g^-ica^-r-&vfe^efeoT^* 

SMSSSiST*. x*XHi, hfcifWX^A 
*fcH»l4PD*ffllr»TA*-r*^ rr\zM 

e^w^ffi-p^snfcs^x-^&AA-ra. ifc, 
$*-i;s^nt, *^5*a«u *et*^7©iRj 

•ra8B»^»«fg©if;:jc*a^<£M^UT i b<t^. c 
5<? ©«j:5»c. •asg^—ics^virftftsa^-racitfc.fc 



-859- 



9 

[0 0 3 3] U t»ieift«±T®«£i&£ 
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7>T-»£ffiftT^T>7-»D-;^ 3 0fc«ggc<Z> 
tfS^A*£M«f ZtctoOWy^*, 5 0tt^> 
£®»fflfH?a 5 2ttfflfflfflff#ffl5 0^ *7>^> 

>^wt2o^-e©ffl^*, >H)cflm&«ttMrr«« 

I EEE8 0 2. 3 Ti^nS^^^LA 
N) \ 5 4ttSJWfflWS*5 0£, MNftTMM 

itfIEEE8 02.4 -rS£$n*J:9ftLAN) , 
60. 70, 80f±7 r 7> hrt©«Bf ICB^n, JftMftl 

Mr***? (KTWfc**5fclft» , 6 2, 7 2, 

8 2«. jWMB»*«5o^6©»*icaoT, -en-? 
n*^^6o, 7 0, 8o©iRi*-«>i»x*«ai-r*& 

#CDn>hC!-^ 64, 74, 8 4|t «Wtfpn#* 
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[0 0 3 6] ®E^7f/UJH 2UPD©-IT^ 
«. ^yf/WH 2±©«©«W*»T»-rfc. » 

fcStfftten*. ?yW**12H»!B'C, 

*>H 20^K65r^7^H 1 0OSSM*«Xi 

fF£UT, (1) «<ff*\ (2) »<#P1\ (3) H 
7-/y-r^<D3®®$ffi^S. F5yiT*£tt* 9v 
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*/t*;k Ttfx, 7^h^X 7-Th? 

5>xxy*A*iH* *-#-F*2*JBV^T* 

cfcK 

[00 37] *^760, 70, 80T«»StlT^S 
T>T$/>*-;X2 0IJRS2 3 2 Cft 

-h*^LTx-f s>*-*3 o&smu Bra®**?** 

<h* »»fcV*r*6 4, 7 4, 8 4&£*»S©A**» 

toft. ^^^6A**nfc*^BXfc?-*14^6ffl 
2j£n3. T-f^t*^7*6C!)A**Hft 

£fc> ^>-T5/>!h-/X2 0KrtNB*LAN5 2ft 

[0 0 3 8] as'te* v>T-»ij— Mff*»0>» 
^IcftoT, flfMMW5 0«jM/T. ir>if9 0. 
9 2fc£j&>Gx-*£A;*JbfcO* 7*^:*X-*9 
4, 9 6&££38B§&f£*r£. V>V3'>tf— /t 2 0 

[0 0 3 9] H2 *ffltiT^>V5/>*-A©«i8*gB 
STfft. 02|:^Tv'3OO«CPU, 3 101^^ 
J0 >*^U* 3 2 0iiT^fX^, 3 3 0BPD, 

*;H2, X^yft3 0ft«tt«nfc»©I/ 
O, 3 4 0IJCPU3 0 0fc£oT£]«£nfc&?KX-- 
^*«ttt*^7^ -;>Xffl7l/-A/^7r, 3 6 

ottA^^n^r^n^ijws^ffl^^^Mk-rftT 5 

3 7 OfcxS^'ftf 3 6 0 4>{ii4r?&5x5; 

77, 3 8 0l^77>f!y^7U-^y7r34 0 
i tffl 7 Iz-AAy 7 7 ©ftg^ LTf Y X ^ 

49 [0 0 4 0] *^7*6A*tfc*»«MIH:v>T3/> 
/X2 0T4jS^^77^y^X^fiKl/m 5 s 

^x^u-r i oics*?*. tfyyjy&myi'—u* 

y y 7 3 4 0 ±4>#MtK:tt«L- 
T, R, G ( B*fi©7-^i:, a€<t*?tfn*x-* 
atttt, t?ft^7U-AA'y77 3 7 0rt(0 
fft«fiSf8£. ?77^y^ffi7l/-A/b77340?i 
©^77>fy^S^T^t©^ttJ$f^^I/ 

-f 1 0©ftH*Cifc«J&r«. ^U>HH»3 8 0fl!> 
(MIL 
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V—J±rty y y 3 4 0 ft<D-ZKDm%<D&til%lt a&T? 
t004 1] 

f (g, v, or) =2 5 5 (ag+ (1 - a) v} 

[0 0 4 2] ^77-<y^ffl7l/-My7r340tt i<? 

#7)Vrtyyy\Z* 2H#OA , >y77^^, x-fX 
:/W l Qlz&fftT&rtyyy&i&ftmft^Z. 

X^H 1 0fc^$nTV>^CO/t-/^r^A*^7 

zt\z-rz>. &rtvyTtmnyyy£<btyQ®%_\m 
.mzrv**. yytzt/yy 4 y?x&mmu JS 
■a»»T bfc>»ATa/t y77 £3* A yyy \z® 0 

*<DAyyy<Dte®%cpufrsm$&t&mLtz.Qm& 20 

[0 0 4 3] 03lCr^X^H 1 O0^H«^0 
-««^r« ^3IC^^T, 1 0 O.ttx-f X^M* 1 0 
C02cSH®, 1 1 0«i>Xx^ft:»^-r^=iT>K$: 
ftfeT%Tctb<D*~DL-fa^ 15 0 «iz>1W£CD? 

tt»ffiS«Wr**. 30 
[0 0 4 4] 04te0ffiifc*fS*£l 3 OO^MO- 

041:^5^ 1 3 2\*±>D-<D$ > z>itL&& 

W^t"^3V>H^fTl-^fc«>cr>^-^- h 13 4IJ 
^x^h£jS#T£t> *0*:/^x*hfcW*r<5-fe 

H4"ett*^x^ h 1 3 4<0^ffifS^ffiT3S<lf U 
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"jr h i 3 4\Z\Z*Zfi?*9 b 1 3 4 7 6 0 

*Wx.9 b 1 3 4<Dffiffltf) : &£A2jt-5£«><ZV? 

h 1 3 4#i&£sn££> ^«^m«2 0 0 

C*7i>x* h 1 3 4«K a rRflM^£n. 

1 4»6tt4-^x^ h 1 3 4^I^lflS$n 

a. 

[0 0 4 5] B5fc, ^y^x^M 34*tHSg^g 

«i 3 o±t?}»esnfciir<3!>«»Swffi«2 o o<z>- 

«3R»Bt, ^>hrtJCBBStl^*^x^ h 1 3 
4fc0#JfcH«£jft*r # B5fc*3&>T, 2 0 2-210 

2 0 2«iJ^-70lpJ#&S9!^r^fcft<D^-i- 
*=x-2 0 2SBftr*z:*:£J:9. ft*? 

fc»©*^a.-* 2 0 6\t**y<Dls>X*fflWLTVk 

-a- 2 1 0tt«DO*^9»7-irfcRfiLa*-rfc 
[0 0 4 6] 4 0 0-4 2 4|it^x^H3 4lCft 

srr*. *fctt«saic**ft«*^x*hT*6. 4 

0 0(1/^*4 1 0, 4 2 0lt *:/>>x£hl34 

±fc»^nfcx*a«* 4 1 2«mjE^-r^-^, 4 

1 4tt««&An*&A4>tf4'X 4 1 6ttttll*tt* 
1t*>Q>#9>* A22\m&&m?*-9. 4 2 4«» 

W>4 14, 4 1 6, 0*»4 2 4f4*IRK*T*ft 

[0 04 7] ft««^fi*2 0 0n««fN»t»T«< 
ffti:. »©fiHKa*S*iTV^*y^x^ htfA* 

8^f«2 0 0T, 1 2fc»Te<JS*£* ^ 

-*4 1 2MMoi^4>ir<»J:?lc»^97-^ 

4 1 2^8,ffi«»:«£3?n4t, *-*4 1 

;*-*4 1 2#X-A'f >$n^^3tc*^^6 001/ 

^5. g^ii#n®®±T^^x^ b\zm\%tin 

(h*%Vi 0 0 6 »C^V>T, 5 0 2 ttX— * 4 1 .2 j^fBt 
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1 2fr$m$:\ttL?Z:m£2tlZ. ZO&o\Z, **y 

[0 0 4 8] 0 711 &&^tk&«2 0 OTv /W/4 
0 0 A;P^400^«(D^*Jr< 

0 7Sebi<dj:pica;^4 o o nz 

S6*a^f J:5K7W74 0 0 
ttSiifcftBfcaHtrr*. H71c*tvt, 5 04B/t 

?jrxn-T*«. ^9!7-fy*Xr!--S0 4tt»ft2# 
^yfWH 2fr&»fi»&rii8**ns. «J0> 
t^^i^h4 1 0, 4 1 4, 4 1 6, 4 2 0. 4 2 
2, 4 2 4ICHLTt)HttO!ft^Rr«T*^. 
[0 0 4 9] Aft«iKM«2 0 OftfiSMNf 

0 8 1 0 fct^yx * h -T* MC * 
T. 08B#*>4 1 4£»fFr*«**LTfr*S* ft 
ftSi*fiBK2 0 0±T> #*>4 1 4^$tlT^5 

#ff»«5 0£tf*LT, 8Hfc**#*>4 14fi»«2 
1-*7^aX— #£>4 MSjfl/T^t^ 
3»ftsft*JW85*U 4 1 4*1 

^CDJBm£LT;*-*4 1 20fttf&tt£tt?B;jM9 
6 0 fcioTJWa»{W2 0 0 fcftLjESn*. Ctt 

*MJ:9;Mttfi*.«. 

[0 0 5 0] B9tt**y/t*;H 2±T0>»0l*9y 
^l:J:oTX^^**4 2 4ft«fFF3«fi3ftL 
T^*. 8fe«*^fi«2 0 0±T, #*>4 1 4)Wfcft 

ant v> $ si < »t«f Lfc*« & ft *«R:B*»-r 

«»iC5*Ltf^nTV^O*^4 2 4 fcftOBSfc 
•&fc#T»<. OS»4 2 4#«ft^t«*, /-^422 

7>T-»ii-;t2 0tt> »*« 
»<»c. M»ffl»»«5 0^UTO^4 2 4Sffl 

To**4 2 4ssa»cft*T. umaot/sfff 
«»fi$*. 

[0 0 5 1] 01 OH *Wx9 hfc»LTaft©» 
0 fc«fr>T. 5 1 0, 5 2 011 «MP**VXJUy 4 0 0 

©«»ttB*»TJi<»i < fci«fc*»fc^fl»«an 

7>7y>^-A t 2 0^ SfflfflftimS 0fi*l,T« 
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TS^>*-;ttt/t*^4 0 0 fi£KH6att«iftffs&4* 

14W76 oic<koTffl»an««a^««2 ooc» 

L£$n* e /W74 0 0<Dl^K:&bi*T* 0^5 1 
0, 512©^$®^ttfeJ;V^ 

[o o 5 2] a 1 1 c*fRrta&:*y^x^ hn*?r« 
w wtifi&m\zizz>. mn £*»t. 5 1 4-5 2 4*1 

•€*n-en*^^x^ b 4 0 0, 4 1 2, 4 1 4. 4 1 
6, 4 2 2, 4 2 4jWtfRrfBac t*«*f*fc»fc 
*»*nft^7-fy>XT»*. 

xc«3R-reft& iBicb«*4««*tt*«#*6n 

[0 0 5 3] 0121:, T*XbUAl/t, ^tf^r* 
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^ 6 0 0 Bx*x h»»ftStfrT*fc*0«»$'- 
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t^fcjfi)^^ra- 6 2 o«a^^j»7r^c:t^ 
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a*u u*->*-«rri» ssM*B»an*. t 
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A*£3fc*;*97--^ICl»gU UBRUfc*^9*6 

*-fca^-r**»fcB^97^ 5^^53.0 fi^rios 

Lfc*B«»KJ:r>T, BfegB^SifcJ: 

ox> eai,fc^**fiftL« , rj:t*«T#*. 
z>ctta<» Ttt*<fia#**«ottscfc#T£r 

4? S. *SUfi«TBx+AhOAAfc*-#-Hfiffl^T 
US**, ^^TOgB^^S^3t^B®«B>5:t # ffi©A 

A#afiffl^T*><fc^. g&gs*- 
k ««*--oH»ta^rsj:9aH»«««KanT 

V***5fcftBfilB*r*±5fcl>"CfeJ:V*i 
[0 0 5 4] *$iSW^ft^013A^02 4S 

50 A(D65nSfi0 1 7 fcaVT. «UU»(H«2 0 0±T^ 
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#flrr*«£) (x^y^i oio), ^o^*y^x^ 

1020) . 

[0 0 5 5] < ^> hftSlCftot^St^i^ K 

mt. tmft&<D*7¥*#b&%*5&£<D&*>tz& 
£LT.»*ti>* Tfcfr*#;*7<&ffiB> Oft, IrI 

#:5*_Sft£o ^ftjfifl-et*. (1)3^tc^x^ 

(2) 2*7c^Kz>2oo^x;i/&«f«*r^. una 2 

[0 0 5 7] (1) 3^jt^)V a? 
)W S^f«ffifi£0i7^^9-^«C»/SLT^^x^h 

*:/vx* ho^^as^2D^xJi'lc^TS»lc^ 
\zr&z>. 30 
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[0 0 5 9] ZfrTt^MZ&^X^z/^Z 

y z (ffiijLj^g^ti^-SO TC^Wkb&flftH 13 k: 

*^^cfcO*<oaS^>3^7nS*^«^ffl^Tfe^; 

400, 4 1 0, 4 1 2, 4 1 4, 4 1 6, 420, 4. 
2 2, 4 2 4lt ^x;k±T?«^n^tl¥ffi8 0 0, 8 
1 0, 8 1 2. 8 1 4, 8 1 6, 8 2 0, 8 2 2, 8 2 
4 £ LT^x;Wfc2nTV>£o 

[0 0 6 0] B114WT> %*y\Z&r>Xm&Ztl 

y\z£z>m&&. 3fr7£&miftizmmisntt7i?x2 

m*. 3&KQffl\*i\zmwzntt-fzS3L? h^2*7c 
¥m\zmm®&irz*<D-?$>z* w®±izte>nrc2$: 
7bm&mm*x s y s &mm&&j&t&sc£\z'rz> 

£, 1i*7\z&z>&m*. ifr*ffi8S*±co-^ (x, 

y, z) &Mmmm%±.<D-& (x s , y S ) ^&-r 

£j£ (1) tlsTfe&itVgZo 
[00 6 1] 

mi] 



[0 0 6 2] 3 (1) K*»*ff5!ITte3.-^E*ff« 

*?<»&®> fi^ mft) ^tffkm^^mm 
oo^€$*t^^nn«-^k:ft^n^ 



[0 0 6 3] Wyi^ h0H£ffi9ttfiB£SX±4> 

-&pjWt££n*:£2K:, tiMBRioeojiiNi 
mffi&m&±<fi&P£*&/vtttm<Dm&i&±\z&%& 

50 ±X&PtZ&&2tlZ>. -eCDE@±a>^0^ 
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7l:a:oT^I:?*«^S2 0 0±lctt#S*V5jK 

t<D&&T?$>Z>. miS lC*5l>Tfc> *:/^x* f> 1 t 

t6&8 4 0<b©£APl#> iJtvK&'oT* 
artlcfc*. 

to o 6 4] *^7«a^etf^^fr^jT&*8e)^ 

HHICiBBU ^©^^x^h^oT*^7*^Ri 
^nTV^®$rPiiStcS»U^^J!l3S^ &®»* (hi 
dden surfaced iminat ion) ££fctpraffift£ (Visible 
-Surface Determination)^***!. ^TIC^K <D7Vt/ 

Foley. vaoDaa.Feiner.HnghesiJv "Conputer Graphics 
Principles and Practice w Addison Wesley^fr (i 9 9 
0) "P. Newman. Sproul 13?. "Principles oflnteracti 
ve Conpnter Graphics" . McGraw-Hi 1 l^fr( 1 9 7 

3) t&E\zmv<m$if£nT\,*z>. &<o^t>®> 
to o 6 5] *^ss«T«e:n^o^7^ ^ 

31C^^T, W-mB 0 0, 810. 812, 8 14. 8 
1 6. 8 2 0, 8 2 2, 8 2 4fc^n^n#Jftfe£iS£ 
LTSK. #7vx*h^£{C^3ftfcfi£IDfi<b 

&mo¥m&a 1 6 . *r. ««eo**7«« 

*HV>-&*>* Ufy^l 3 0 0). RBV*&Jbttfc*;* 
13 10). V>T$/>D— 0Ttt#lCSftO*;* 

7frv?\ 3 1 OTS3£$n^:fcfrL-^ff511tS^i 
r34 0«>B/Xy7 7fc«Brr«, CO»BTtt8«ifl! 
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10 0 6 6] HI 8*>&B2 4ftJB^T. 2*56*5^ 

i0 *KOtt«*»tt#j6fc-f*. tot, 2*76*^1? 

x^h^^awT^Mfc-r^ 

?9-*K*l**=r:/3>x*htt, Bffi£S*lC*tt£ 

Aa «JC0B# (WAtf, #ft»^>a**»&» CJHto 

10 0 6 7] HI 8. El 9. m20\Zfi*7U-9t 
2&7t*7 : )l't<Dtt&m&&7jk-?o #BO£BlC. ®* 
it? ©#j*?7-^fc#t-£l&»^^2 0 OCD^^SB 
*£> *H©;MK:«*©**97-jrfc»« 
t**^x* h©2*7C^x;^^-Tc Hi8feH»c 
*V>T. MK±©4*^xjr h4 10.412,414. 
4 1 6, 4 2 0, 4 2 2, 4 2 4H *0©2^C7C^:t ! 

;^tt^n-en«»fli«7 io. 712. 714, 71 

6. 7 2 0. 7 2 2, 7 2 4£LTSS3*U>. -O© 

*g»O»*0£fii*7!x-A£l¥-K. *^57-^lfc 
»iS-r^®^71/-Al«^m^710, 7 12, 7 1 
30 4. 7 1 6, 7 2 0. 7 2 2. 7 2 4^^«^nS. 
019, 02 0lC^a*^7 r 7-^lC^f«5ffi«>'W 
-A©«*«T. H19IC*VJT* *^97-^2fc# 
*f «<H«7U-A2tt, Jg»««7 4 0, 7 4 2.74 
6, 7 4 8a>e>$f££n5. *gjg«#7 4 0, 7 4 2, 
7 4 6, 7 4 8i*en-£n*:/vx^ h4 1 2. 4 1 
6. 4 2 4, 4 2 2K*fo&T3 0 f^SllC. B2 0lC#^ 

S«7 3 0*&4R««n«. Jg«S«7 3 0tt*^x 
*K4 0 0|C»J6T*. HU*^x^hTt>. 

ft«7 16IC*M5U *^^ l 7-^2 0^piCtt7 4 2{- 
-5. 

[0 0 6 8] H2 2, H2 3. B 2 4 iC 2 ftTC^/t'O 
x-^flKSftS-T. H2 2*5^T, 1 3 0 014^*^^ 

^. *^7x-^x-yjn 3 ooi:it ^»rto^ft 
* ^ 5 \zttfe~?m®y Aox-^3Wft»sn 

5(? a. 
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[0 0 6 9] @2 3(C^T, 1 3 2 0tt^7^ t*tt&V (Xf'^1 2 2 0) > «f^> hffigfcfc* 

<z>x-*t**. v>?-*\t, ft*?®* mm*%?fr?it$*<D&^*±&<D&mmzm-. ± 

fpT€r^a^»> -ene&aff-r^^cox^t)*^ ia^are&oigatxs 210).. 
^y-^x-^^oiciiftrrntfci:^ [0072] 2 ^c^xM* 2 :r;Me8y-;u£ 

^2 o\***7V-27 : -?&%*7Mwm3>h C0073] (u ii^^mimm 

[0 0 7 0] ®2 4«-®«7U-A(3!>x-^SIig^ [0 074] • ®ffi±ICg^Snfc:/?> K9ffiBB± 

\ Btt^U-ASr-^tt. «*:7^- A W^zJ h£it£TS 9* W^/i^ 

X-^JCtt, BB£B£fcmt££&Btt0&B (x, [0 0 7 5] •®M±lC^^njty7>hCDffi®0± 

y) , JgJ&®#<D;*:££ (w, h) , #:/>*x# hofc Trt;*?0>eg£nT^£®ffi£m^5. 
ttttfli, Sfrffr ttflnfim^Sfc*. :*:/S*x£ h<Dg* ^7 [0 0 7 6] • ^CD#^*SJ^:<h*Oi8SiIT^Jt^ 
• ttfttt. *^3>xar htfBttfrTBB**^?*--*'-? 
»So ^^^x^ h^Stt^JBtC^-St^tC^ *-CD [0 0 7 7] (2) #*97-*8Be«iB 

*:/3>x*httH«;Sn&K *£tt*^fc&*:*:/vx b3I2*^7S««I6I-J:oT, sw^n^^^^is 

t— 3 4 o^cotf-r^atjftttsn*. [007 8] (3) mmimmtfe 

/»fPS**'r-^ 1 3 4 0 fctt, htfP D HH±fc**dnfc*Mfc±T, B»*ff*Brt 

fc<fcoT»3eatifcBfc, «f?r^»fp*t* -con b«v mm. n. fttm, &&mm*z<o&*BWB* 

/WH 2*a<ffbfc»&t, «<»L&«*tf«-f- 50 [0 0 79] (4) <^>h/ftft*haWB 

0#-f >***»JttStt*. tfiD^I;:»^*fcfe<0jOf«* JSa^^BXK* 8S3 0^, 3S9^, 1 2 0 0*-y* 

*Wx.9 mcBjMit-*;* h ft, &12 i o^-v^^co r^a-ifo^x-x 

fc«fcoT, t^i^hCIWcfWhtS^ [0 0 8 0] »E2*7C ; E5 f ^3aSl!y-;UTttTfB*« 

^>©Ma«WfcaKsufcOTf**. [oosij ^mi i**7&&.W3*yy-2<?>m& 

[0 0 7 1] 02 2^S^xJ^ffit3T^'/> ? x MB (1) ?BMMB&JBt>T. *>^^S«L,, 

^hftH*-r*#B**r. sftcoA^^^-^ BBJb»c-t©8fe«**«-r«, ^fcasna (2> 

0*6«Wr* Ury^l 2 0 0). *lc®«7l/~ WM^f^o 

A«B*"r*««©&*^6. <^>h&S^ty®^ [0 0 8 2] ^«2 : sj-^x* 

TV*MBteffllt**SOr- jr fc, ' < ^> httl 50 TftttLfcV^^xir hO«»*««B (2) B»»B 
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[0 0 8 3] 5fJS3 : *f «>htWlf&>m%8t 

mm (4) -f*>h/Wiftttfemmmzm»x. ^©2 

T<ftlL&4>&<t'&-:D©0J&£gJRl,T. -fS>h 
£»ff©*t££®-r5. 
[0 0 8 4] ^K34 : 5£SW§W«# 

82 3, 0 2 4fc^Ufc?-*#li&T»£;*nS. &© 
rt*^ ffi©#,*7'7-^C#UT2&7C : e7 ; ;t,£fls 
jftlsfctofcfrtt. ¥KI1^6^J@4*'eSJS»)^-r. i<7 
[0 0 8 5] *^x^ h©*5r;n&JSoc: tcitj 
T. »S*:/5>x*M<8^rt©££fc£©*?K:a^ 

[0086] -^xx^h©*gir, mm, m^-n. 

[0 0 8 7] -^v^^XTffrfcbfc^^x^h- 

[0 0 8 8] -*^x^h©#jnifffl^A*snfc^ 

[0 0 8 9] • *^7T?f*^-rrt©T?^ft:^yvx 

3. ffiifrt©*SS©«S?£to©-fe>-tJ-*>S®£ 

^©5felSlCttoT^SEW©±fc^^ir*« H» 
IC, 7©*©jkjft©«^ •fc>1tt>&ftS 

[0090] . asait^ft^x^ h»» ?77 

£X££fifcLT, x-^t^®W©*^x^ K©B8S 47 
[0 0 9 1] 

[529]©3!>£] #3B9]©&#tt. TI2 (1) (6) 
[00 9 2] (1) &1&mm&ni'Xy-&tet\Zis^ 

[0093] (2) *^^©a^ ut^ommt? 
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[0 094] ( 3 ) S«ffl«l®±TSfP&ff ft 5 £ 

-ess. r©fc». >g&*:=.9tmimt*:mz&& 

[0 0 9 5] (4) ;tr;K?MtCjr?7<ry.?X£&£ 

[0 0 9 6] (5) sa©ws*s^<«s:^fl9-c#s 
jTr-s/^tT* ^-©8?»t0aa-r5-fe>u-©®s*-rh 

i/>Hy77$giStt5Ct«5-ct5. ^nciD. 
5yg©*^£*g^«fc=W8?T£*«fc 5 fcfc*. 
[0 0 9 7] (6) mmzfthrm®&ftzittz.z£7 

[0S©fBS^ftlKW] 

[01] *«W»C«fc57 r 7>hS^Sffl->XxA©ife*f: 
[02] v>v^>-9— A©A-H^XT»^T»«. 
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[07] ^-^x^h}g^»CJ:5*^7'7-^S^©- 

[08] hmfe\z&zx*>®ft<D-m*m 

-T0. 

[09] *7vx*hm£l;i<fcSX5K^8fP©-^ 
^T0. 

[010] ®mmtt.£&z>Wift<»-m*:K?®. 

[011] SffnItB^^xi7 h©W^^-T0. 
[012] ^*-fc«fc5Bfe»^©«S|S:^T0. 
[013] 3*7Ctx;l/©#!I*^-r0. 
[014] 3*7C ; ex;i'i:H®±©*«i:©M^*^-r 
0. • 

[01 5] mm±*>&t*yvx.t> htomm^f 
0. 

[0i6] 3*si : e? g **m»it*7i>x.9 nimbus 

[017] fESg09©SIS*ft©¥«S:^-r0. 

[018] 2# 7 c^x;l'£;&;*77^£'<»:©(JI«£^-f 
0. 

[019] 2'J&* ; r)\>t.iJ*yV-9£0)W&&KCt 
S'Jfc0. 

[02 0] 2'&7i : £T)\'tll*?y-?tV>W%&7£t 

[02 1] 2^7C : E7 i JP^ffl^&^v ? x^M3l^jaJa 
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[0043] 

Figure 3 shows an example of the display screen 
structure of display 100. In this figure, component 
designations are as follows; 100: display screen of display 
5 10, 110: menu domain for assigning commands for the whole 
system, 150: data display domain for displaying data from 
sensor(s) and various materials and data related to the 
plant, 130: draft display domain which displays 
configuration, structure and planning drafts of the whole 
10 plant as well as parts, 200: image display domain which 
displays images inputted from the camera. 

[0044] 

Figure 4 is a display configuration example of draft 
15 display domain 130. In figure 4, 132 is a menu for issuing 
a command to define the location of sensor, and 134 is an 
object, which appears on the draft selected by the operator. 
If the operator selects an object displayed within the 
draft -displaying domain 130, information from the sensor 
20 for the selected object gets displayed on data display 150 
or image display domain 200. For example, if the camera 
is selected as the designated sensor for the selected object , 
images inputted from this camera is displayed on image 
displaying domain 200. In the case where a hydraulic 
25 pressure sensor is selected, graphics defining the current 
oil pressure and a trend graph showing the change in oil 
pressure are displayed on data display domain 150 . If touch 
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panel 12 is pressed strongly, the object displayed on the 
pressed area is selected. If there is no sensor associated 
to the selected object, nothing occurs. Figure 4 shows 
pressing of the area of touch panel where object 134 is 
displayed. If an object is pressed with a finger, the 
object is highlighted to indicate selection. In the 
example shown in figure 4, camera 60, which visually 
captures object 134, and microphone 64 , which captures noise 
around object 134, are designated as sensors of object 134. 
When object 134 is selected, images of the object is 
displayed on image display domain 200 , and noise around the 
object is outputted by speaker 14. 

[0045] 

Figure 5 shows the relationship between object 134 
allocated in the plant, and the display configuration of 
image display domain 200 when object 134 is selected on 
draft display domain 130. In this figure, component 
designations are as follows; 200-210 :menu for camera work 
setup for the camera capturing currently displayed image, 
220:menu defining selectable objects within displayed 
image, 202:menu for camera angle setup which allows panning 
of camera in vertical and horizontal directions, 204: menu 
for zooming in by controlling camera lens, 206: menu for 
zooming out by controlling camera lens, 208: menu for 
returning the camera-work setup to the configuration just 
prior to the current configuration, 210: menu for returning 
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the camera-work setup to the initial configuration. 
Figure 3 

100: display screen 
110: menu domain 
130: draft display domain 
150: data display domain 
200: image display domain 

Figure 4 
132: sensor 

Figure 5 

#1: operation observation room 
#2: work site 
210: whole body . 
220: object 
410: power 

420: hydraulic (oil) pressure 
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